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ON NEWTON'S METHOD OF APPROXIMATION 
By Henry B. Fine 

DEPARTMENT OF MATHEMATICS, PRINCETON UNIVERSITY 
Received by the Academy, August 8, 1916 

In the first of the following theorems 1 a condition is given under which 
Newton's method of approximation for computing a real root of an 
equation/^) = and the extension of this method used in computing a real 
solution of a system of equations /<(*i, x 2 , . . . , x n ) = 0, (* = 1, 2, . . ,n), 
will with certainty lead to such a root or solution. The condition relates 
to the absolute value oif{x) or of the functions fi(%i, x 2 , . . . , x») cor- 
responding to the initial values of x and of the variables Xi, x 2 , . . . , x n 
respectively. No assumption is made as to the existence of a solution. 
On the contrary it is proved that under the condition to which reference 
has been made one and but one solution exists in a certain designated 
neighborhood of the initial x or (xi, x 2 , . . . , x n ). The second theorem 
is the extension of the first (for n = 1) to the case of a complex root of an 
analytic equation /(z) = 0. 

Theorem 1. Letfi(x u x 2 , . . . , x n ), (i = 1, 2, . . . ,n), be a system 
of real functions of the real variables xi, x 2 , . . . , x n which have continuous 
first and second derivatives in the region R, (x^, xf, . . . , #£ 0) ) a set of 
values of x h x 2 , . . . , x n belonging to this region, and (fi, &,...,£» the 
set of numbers determined by the equations. 

fAxf\xf\ . . • ,4 0) )+2^ = ° (* =1 > 2 > • • •>**) 

and let S denote the interval, circle, sphere, or hypersphere whose center is 

(*i 0) + £i, . . . ,. xi 0) + £„) and whose radius is p - I j>\ %\ J, S p being 

supposed to belong to R. 

Suppose also that in S the functional determinant F of the functions f t 
does not vanish, n( < « ) is the upper bound of the absolute values of the frac- 
tions whose denominators are F and whose numerators are the several first 
minors of F, and v{< o°) is the upper bound of the absolute values of the 
second derivatives of the functions fi. 

Then, if 



2{/K4 0) ,4 , \ • • .,*i 0) ) 



L i=\ 



1 / N 

n' ij, v 
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the equations f { = have one and but one solution in S, and an approximate 
value of this solution, as close as may be desired, will be obtained by de- 
terminations first of ^ fl , $>, . . . , gp and then of x[ i+1) , x[ i+i) , . . . , 
x ( „ i+1) , for j = 0,1, 2 . . . successively, by the equations 

U (*M\ • • • , xf)+ J£ H?F = 0, (* = 1, 2, . . . ,n) 
xi j+i) =xP + &, (*=1,2,. . .,»), 

(wAere ^ 0) = &), ^e solution being lim i== „ (asi^, a^, . . . , xi }) ). 

Moreover the equations (b) will yield a similar sequence of approximations 
to this solution if instead of (*{ 0) , xf\ . . . x ( ®) any other point in S be 
chosen as the point of departure. 

For the case of a single equation f(x) = the condition (a) reduces to 

\f(x )\<-, (a') 

v 

where X (>0) is the lower bound in the interval S of the values of \ f (x) | . 
For let 

&-*<!&,&,. ■ • ) 4 )^,-=|2[^ ) ] 2 |%i=J2fo w ] 2 | : 

Then, if both {xf,x<?\ . . . , x?) and (x? +i \ xi j+1 \ . . ., *i i+1) ) are 
in S, 

where each x ( k Si> lies between x' k j) and x[' +1) . 

Hence if the numbers $' be so taken as to satisfy the equations 



we shall have 



r"=sts£pi?A (i-M, . .,»), (3) 



'^^ ab- 
solving the equations (2), we iind 



? 0) = _ i=L____ , (A = 1, 2, . . . , n), (4) 
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where Fj is the value of F for (x u x 2 , . . ■ , x„) - (x^, x ( 2 J) , . . . x ( n j) ), 
and A$ the cof actor of the element in the *th row and the Ath 
column of Fj. But 



Hence 



i »=i 



i=lt 



P 2 S^— ^[m<nv* 



<=1 



and therefore 



Pj^n/j, <j>j. 



(5) 



Again, the expressions under the summation sign in the equations 
(3) are of the form 



2^t a M & & 



and 



k,i=i 






(6) 



,;=i / *=i 



where a denotes the greatest of the numbers | a ik 
Hence 



•»♦• ■*■(")' II K 



m's^rf 



and therefore 



-Pi+t ^ 



« 3/2 «< 2 



From (5) and (7) it follows that 



*»i+i ^ A t *i, where k x = — i^, 



Pi+i 5*2 pj, where A 2 



A, « 5 V 



(7) 

(8) 
(9) 



nn 2 

Hence A l¥ >,- +1 g (A^) 2 and therefore, by setting./" = 0, 1,2, . . . suc- 
cessively, 

Ai*>,-S(A,4> ) 2 '. (10) 
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Similarly 

k 2Pj £(k 2 pf, (11) 

Let r denote any positive number less than 1, and suppose that k t <p < r. 
Then since, by (5), p^n/ifo, we also have k 2 p<r, and therefore, by 

(8) and (9), 

k 2 <pj<r 2i , k 2Pj r 2J \ (12) 

Again p j+l g k 2 pjpj and therefore 

P j+ i< r 2 ' Pj . (13) 

Also, k 2 pj^ k 2 p {k 2 p) 2 ~ i and therefore 

Pj < r' lLl p. (14) 

Therefore, since r< 1, the sum Pi + p 2 • • • pj increases with j to a 
limit which is less than pr/(l — r 2 ). 

But pr/ (1 - r 2 ) < p when r ^ 1/2. 

Therefore when r = 1/2, that is when the condition k i (f> < r becomes 

2k x n' ,2 ixv 

the point whose coordinates are xf = (4 0) + £* 0) ) + I* + • • • + ?F _1> , 
(& = 1, 2, . . . , «), will remain in 5 asy increases and will approach a 
definite limiting position {c u c 2 , . . . , c„) in 5 as j' = » . Moreover 
by (12), lim^ =co ^- = 0, and therefore, since the functions /,- are con- 
tinuous, f { (c u c 2 , . . . c n ) = 0, (i= 1, 2, . . . n). Therefore the equa- 
tions fi = have the solution (c u c 2 , . . . c„) in 5. 

Observe that it follows from (5) that when (15) is satisfied, 

2k 2 n' (iv 

The equations /< = have no other solution than (c h c%, . . . c n ) in S. 
For suppose that (ci + hi, . . . , c n + h n ) represents another such solu- 
tion. Then by developing as in (1) and applying (6) 



V<*,,A 



v fc ? 



0= Z^r^ + ? M "2-^ (* = 1.2,. . .,n), (17) 

where | ( - 1 ^ 1. 

Solving these equations for the numbers h k in terms of 2_, %, we 



obtain, by the method used in deriving (5) from (2), 
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S 



fl ' [IV 



2*2. 



i-1 



and therefore, if A| =1= 0, 

» 11 



2*: 



L*=i 



n i/2 nv 



> 2 



P- 



(18) 



Hence (ci + h, . . . , c n + h n ) lies outside of 5. Therefore the exist- 
ence of a second solution in S is impossible. 

The equations (b) will also yield a sequence of approximations to 
(ci, c 2 , . . . , c„) similar to the sequence {xf, x 2 \ . . . x$P) if instead of 
(xf\ x 2 0) , . . . x ( ° } ) any otlier point in S be taken as the point of de- 
parture. For let (af>, af\ . . . , a®>) be any point in S, and $>, a ( k i+l , 
dy, (k = 1| 2, . . . , «), the numbers determined by the equations 

U {flf, <#>, ..., a?) + 2 || *S° = 0, (* = 1, 2, . . . , ») , 

4 ; ' + " = <*P + €i fl , 4'° = c» - oV, (* = 1, 2, . . . , n), 

iorj = 0, 1, 2, . . . successively. 
Then since 

c k = oi» + «#> = flF + (#> + 4 y+ '), (* = 1, 2, . . . , »), 
we shall have, on developing as in (1) and taking into account the 
equations which determine the numbers $\ 

= V ML-M+iy + i V b2fi 



M-l * 



*=1 ~^* 

where each x^ {) Hes between a^ and c k , (k = 1. 2, . 
From (19) it follows, as in the proof of (5), that 

5 j+1 ^k 2 5 2 , 



;«#><#>, (.'=!, 2,. . .,»), (19) 



»). 



(20) 



4=1 



where fy = ] ]V M^Ff and, as above, k 2 = n 5/2 /j.v/2. 



From (20) in turn it follows, as in (10), that 

M,-=§(Mo) 2i ; 



(21) 



therefore, if & 2 S < 1, that lim,-_„ 5 ; - = and lim,=» (a^, a 2 j) , . 

— \ C U c 2j • • • - C J- 

But 5 is the distance of the point (af\ a l 2 0) , . . . , a® } ) from the 
point (c h c 2 , . . . , Cn), and & 2 S < 1 if 5 <l/£ 2 '; therefore, by (16), if 
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5 <2p. And the condition 5 <2p is satisfied if (a ( ° } , af\ . . . , a£ 0) ) 
be taken anywhere in S. 

Again since k 2 5 Q = r < 1 we have, as in (12), Sj^i 3= (k 2 Sj) 5 ; - ^ r 2 ^ %< 5,-. 
Hence each approximation in the sequence (a^\ a { 2 j) , . . . , a ( n j) ), (;' = 
0, 1, 2, . . . ), is closer than the one which precedes it. 

Finally, by (21), fys: r 23 /k 2 . Let j' be any value of j such that 
r 2J '/k 2 < 0.1 and r 2J ' < 0.1 and set j =f + 1 (I =0, 1, 2, . . . ). We then 
have 

V-h^-t- = ^-(^) 2 - 1 <(o.i) 2i . 

«2 *2 

!» H I * )* 

/ [oi" + '] 2 [ will coincide with] ^ c\ ■ and therefore <z/ + ' with 
*-i J ( *=i J 

c k (k = 1, 2, . . ., ft), to at least the 2'th decimal figure. 

Theorem 2. Let f(z) be any function of the complex variable z which 

is analytic atz = z , and h the number determined by the equation 

/(*„)+/'(*o)A = o: 

Let S be the circular region ivhose center is z +h and whose radius is 
P = \h\, and suppose that, in S,f(z) is everywhere analytic, X(>0) is the 
lower bound of the values of \f'(z)\ and t>(< °o) is the upper bound of the 
values of \f"(z)\. Then, if 

|f (so) | <_*=-, (a") 

V 2 v 

the equation f (z) = has one and but one root in S, and this root will be 
approximated to uninterruptedly by successive determinations of hj and 
z J+ ! by the formulas 

f (%) +/' (%) % = 0, z j+l = zj + hj, (j = 0, 1, 2, ... ). (b') 

(where h — h), the root being lim^w Zj. 
For let 

Zj = x + iy, f(zj) =<p(x,y)+if (x, y), A,- = £ + in- 
Then if Zj and z j+ 1 are in S, we shall have 

+ 2\^ +2 ^w^ + W 2V ) (22) 

where a;', x" lie between a* and x + £; y', 3'" between y and y + ij. But 
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dV gj i, dV 
dx' 2 dx'by 



7 Sl- 



av 2 

5/^ 



d* 



„/2 V? f ^ * A , 2 CT 



&** 



{©H0]7{^W-'^. 



Similarly 



Therefore 



£>V £2 , 9 dV e a dV 2 



d#' 



in' 



i>x"dy' 



by' 



in' 



^AhV- 



f(z i + k j )=f(z j )+f'(zj)k j + J±i?2 v \h j \\ -i<e u e 2 <i, (23) 

Hence if hj be so taken as to satisfy the equation f (%) + f (zj) hj = 
and if, as in the proof of Theorem 1, we set \hj\ = pj, | /"(%) | = <fe, we 
shall have 

1 



Pi^-fj, 






But these are the same as the inequalities (5) and (7) in the proof of The- 
orem 1 for the case n — \ except that v is here replaced by a/2j\ It 
therefore at once follows from that proof , and in particular from the in- 
equalities (15) and (18), that if ^> s> <\ 2 /'v2v and therefore p = p a <\/v'2v, 
the equation/(z) = has one and but one root is 5; also that the equations 
(b)' will yield a sequence of approximations to the root if instead of z 
any other point in S be taken as the point of departure. 2 



1 This paper was read before the American Mathematical Society, April 29, 1916. 

2 The distinctive feature of the method used in this paper is the determination of a 
number C such that if <po <C, then liny = m <Pj •= 0. In this respect it differs from other 
discussions of Newton's method which I have been able to find. Of such discussions the 
following should be mentioned. Cauchy (Oeuvres [Ser. 2, Vol. 4], p. 573) obtained p </X2c 
as the condition for the existence in 5 of a real root of a real equation obtainable by Newton's 
method, and p<X/4» as the corresponding condition for a complex root. Quite recently 
G. Faber (/. Math., Berlin, 138) has proved, for an analytic equation /(z) = 0, that if 
l/(z)/ "(z)/[/'(z)] 2 l <« <1 in the circle whose center is zo and radius p/(l— a), a root of 
f(z) = 0, obtainable by Newton's method, exists in this circle. I have been unable to dis- 
cover any previous proofs of the existence of a solution for the case »> 1. But Runge 
(Encyc. Math. Wiss., 1, p. 446) and E. Blutel (Paris, Acad. Sci., C. R. 151, 1109) have given 
proofs that if a solution exists at a certain point C, there must also exist a region R about C 
from any point of which a steady approach to C will be made by Newton's method Blutel's 
method of proof (an extension of one employed by Cauchy) being that which I have used 
in the proof of the corresponding part of Theorem 1. 



